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ABSTRACT 



The Even Start Family Literacy Program addresses the basic 
educational needs of parents and children of low- income families by providing 
a unified program of: (1) adult education and literacy programs for parents; 

(2) early childhood education for their children; and (3) assistance for 
parents to effectively promote their children's educational development. This 
report describes the Even Start Program at the end of the third year of its 
second national evaluation. Following an executive summary of the evaluation, 
the chapters cover: (1) principal components of the Even Start approach; (2) 

Even Start national evaluation, including the scope of the 1995-96 
evaluation; (3) characteristics of Even Start families; (4) services provided 
to participants by Even Start projects; (5) extent of participation in Even 
Start services; (6) services provided to the neediest Even Start families; 

(7) educational and developmental outcomes of Even Start participants; (8) 
relationship of program outcomes to participant and project characteristics; 
and (9) resources that best support Even Start services. Among the findings 
noted in these sections are that: about 85% of 1995-96 enrollees had neither 
completed high school nor earned a GED; over half of Even Start projects were 
located in rural areas; across all educational components, projects commonly 
relied upon individualized instruction using curriculum materials externally 
developed by other programs; and major challenges to program implementation 
included improving attendance, improving participants’ retention or 
motivation, obtaining sufficient financial resources, and obtaining adequate 
transportation. The report’s three appendices detail Even Start legislation, 
provide additional data tables, and present content validity of measures used 
in the sample study. Contains 32 references. (HTH) 
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The Even Start Family Literacy Program addresses the basic educational needs 
of parents and children of low-income families by providing a unified program 
of (1) adult education and literacy programs for parents; (2) early childhood 
education for their children; and (3) assistance for parents to effectively promote 
their children’s educational development. All Even Start projects are required to 
provide services in each of three "core" areas corresponding to the broad 
programmatic goals of Even Start: adult education and literacy; parenting 
education; and early childhood education. Projects provide direct support for 
services and also build on existing community resources by collaborating with 
other service providers. 

The Even Start program was initially authorized by the Elementary and 
Secondary Education Act of 1965 (ESEA), as amended by the Hawkins-Stafford 
Elementary and Secondary School Improvement Amendments of 1988 (P.L. 100- 
297) and amended by the National Literacy Act of 1991 (P.L. 102-73). In 1994, 
the Even Start program was reauthorized by the Improving America’s Schools 
Act as Part B of Title I of the ESEA (P.L. 103-382). 

Even Start was first implemented as a federally-administered program in fiscal 
1989. Since 1992, the program has been primarily state administered. The states 
award subgrants to partnerships, each consisting of at least one local education 
agency (LEA) and at least one community-based organization, institution of 
higher education, or other public or private non-profit agency. A few types of 
projects remain under federal administration, including special set-aside 
programs for migrant families, Indian tribes and tribal organizations, and insular 
areas; discretionary grants for statewide family literacy initiatives; and a family 
literacy project in a prison that houses women and their preschool-aged children. 
Since 1989, the program has grown from 76 projects serving approximately 
2,500 families to 576 local projects serving approximately 31,500 families in 



Two types of evaluation are required of all Even Start projects by law. In 
addition to an independent local evaluation arranged for by each project, the law 
requires the U.S. Department of Education to conduct a national evaluation. The 
first national evaluation documented the program’s early development from 1989 
through 1993. The current national evaluation, covering the next four program 
years from 1993 through 1997, addresses these questions: 

■ Who is served by the program and what services do they receive? Is the 
program reaching the appropriate target population? 

■ How is the federal funding spent on the program? How are Even Start 
services implemented? 



1995-96. 



The National Evaluation 
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■ How well does the Even Start basic model work? What educational and 
developmental gains are achieved by program participants? 

■ What are the characteristics of effective practices and programs? 

The evaluation data collected each year are reported annually in interim reports. 
These reports are primarily descriptive and are intended to provide interim 
updates on the characteristics of program participants, the nature and extent of 
services delivered, implementation problems, and measures of educational 
outcomes. The final report will incorporate findings from the entire four-year 
period as well as from the previous evaluation to present a more comprehensive 
discussion of evaluation outcomes pertinent to program policies and operations. 

This interim report focuses on the 1995-96 evaluation data. The findings 
described throughout this report draw from two sources: (1) the Universe Study, 
in which all projects annually submit data on program implementation, intake 
interviews of new enrollees, and services received during the year by all 
participants; and (2) the Sample Study, which collects data on program outcomes 
from a sample of fifty seven projects. 1 For the Universe Study, 563 (98 percent) 
of the 576 projects operating in 1995-96 returned evaluation data by the final due 
date. Of the fifty-seven projects in the Sample Study, fifty-four projects (95 
percent) submitted outcome assessment data. 

The interim and final reports resulting from the national evaluation summarize 
information reported by individual Even Start projects. They are intended to 
inform the decisions made by service providers and local, state, and federal 
officials to make the most effective use of available resources in their efforts 
toward program enhancement. 



Even Start Participants 

Even Start is designed to serve low-income families with parents who have low 
levels of adult basic and/or literacy skills. To participate in Even Start in 1995- 
96, a family had to have (a) a parent who was eligible for adult education 
services under the Adult Education Act and (b) a child younger than 8 years of 
age. Beginning in 1995-96, teen parents, who previously were not eligible for 
adult education services because of their age or school attendance, also became 
eligible for Even Start. 

Consistent with the purpose of the program, Even Start projects are serving 
families who are disadvantaged economically and educationally. In 1995-96, a 
large majority of families enrolling in Even Start had incomes substantially 
below the federal poverty levels (e.g., $15,91 1 for a family of four with two 
children in 1996). A majority of parents were without high school diplomas or 
General Education Development (GED) certificates at the time of enrollment in 



Exhibit 2.1 in Chapter 2 summarizes the components of the current evaluation and 
data collected in each component. 




vi ■ 



Even Start - 1996 National Evaluation 



8 



Executive Summary 



Even Start. Less than one-third of parents were employed, and about one-quarter 
had limited or no English language proficiency. 



Family Characteristics 

In the 1995-96 program year, approximately 31,500 families, comprising 36,400 
parents and 47,800 children, participated in Even Start across 576 projects, based 
upon data submitted by 98 percent of all projects. The average age of adult 
participants in 1995-96 was 28 years, one year younger than in the previous year. 
This reflects an increase in the enrollment of teen parents from 9 percent in 
1994-95 to 15 percent among the 1995-96 new enrollees. The average age of 
Even Start children in 1995-96 (3.8 years) also was below the previous year (4.4 
years); 36 percent of children who enrolled in 1995-96 were under 3 years old. 

As in the previous year, the average size of Even Start families was between five 
and six persons in 1995-96. The typical Even Start family was a couple between 
the ages of 20 and 39, with three to four children. Another large group of 
families was headed by single parents with four children. 



Family Income and Employment Status 

More than 80 percent of Even Start families in the last two program years had 
annual incomes under $15,000; 42 percent of 1995-96 enrollees earned and/or 
received annual incomes under $6,000. These incomes were substantially below 
the federal poverty level, considering that the average Even Start family included 
five to six persons. 

Employment wages constituted the primary source of income for 46 percent of 
the families who enrolled in 1995-96. However, 47 percent of families had 
incomes low enough to qualify for and rely primarily on government assistance. 
The proportion of parents receiving government assistance at the time of 
enrollment has increased substantially, from 43 percent to 53 percent, since 
1994-95. More than 60 percent of teen parents were receiving government 
assistance at the time of enrollment, compared with 49 percent of parents over 20 
years old. Only 23 percent of participating parents were employed at the time of 
intake in 1995-96. Of these, slightly more than half had full-time jobs; 44 
percent had part-time jobs. 

Parents’ Educational Backgrounds and Reasons for 
Participation 

While it was rare that parents had had no formal schooling, nearly one-third (30 
percent) of new 1995-96 enrollees had not gone beyond 7th to 9th grade. 

Further, 12 percent of new enrollees had not progressed beyond the primary 
school grades. About 85 percent of 1995-96 enrollees had neither completed 
high school nor earned a GED. 

For roughly 60 percent of Even Start parents, Even Start represented their first 
experience with adult education programs. Similarly, only a small percentage 
had participated in employment or vocational training either before or at the time 
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of enrolling in Even Start. Fifty-seven percent of children enrolling in 1995-96 
had received no early childhood education services prior to Even Start, but this 
may well reflect the fact that over one-third of these children who were new to 
Even Start were under 3 years of age. Even Start was the only program 
providing educational services to 50 percent of new children at the time of 
enrollment. 

When asked for the primary reason for enrolling in Even Start, the most 
frequently cited explanation by parents was to improve their own educational 
status. Parents next listed the desire to learn English, followed by improving 
their child’s chances for academic success. 



Parents’ Race/Ethnicity and English Proficiency 

Even Start families represent a wide spectrum of racial/ethnic backgrounds. 

Since 1992-93, the proportion of Hispanic families in Even Start has increased 
substantially, reaching 38 percent among new families that enrolled in 1995-96. 
The second largest minority group was African American (23 percent). Asian, 
American Indian, and other groups collectively constituted 8 percent of the 
1995-96 enrollees. 

More than one-third (38 percent) of new families enrolling in 1995-96 were 
headed by parents who did not speak English at home. Most of these parents had 
difficulties in understanding, speaking, and/or reading English (roughly 30 
percent of new enrollees). The Hispanic and Asian parents’ educational 
experiences averaged between the 8th and 9th grades, with most of their 
schooling completed outside the United States. 



Extent of Need Among Even Start Families 

Multiple disadvantages characterize most Even Start families. The neediest 
families participating in 1995-96 were identified based on the following seven 
indicators: 2 



2 The percentages of families identified as having each of the seven need indicators are 
shown in parentheses (the percentages refer to all 1995-96 participating families). 
Some need indicators are based on data collected at individual adult and child levels, 
summarized to the family level for families with multiple adults and children 
participating (i.e., at least one adult or one child reported the “need” condition). 
Further, the need index for “families receiving welfare” was based on answers to 
either one of two questions related to receipt of welfare. Due to these steps taken in 
creating the need index variables, some of the family percentages differ from 
percentages reported elsewhere in this report for adults , children , and one variable at 
a time. 
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1) Families with annual incomes under $12,000 (71 percent of families); 

2) Families in which at least one participating parent has a 9th-grade or lower 
education (47 percent of families); 

3) Families relying on government assistance as the primary source of income 
and/or receiving government assistance at the time of enrollment (6 1 percent 
of families); 

4) Families headed by parents for whom it was difficult or who were unable to 
read, speak, or understand English (32 percent of all 1995-96 participating 

families); 

5) Families headed by single parents (38 percent); 

6) Families with four or more children under the age of 16 (42 percent); and 

7) Families in which at least one participating child has a disability (e.g., 
speech/language impairment, visual impairment, mental retardation, or 
learning disability) (15 percent). 

Projects are required to recruit and serve families most in need of Even Start 
services in their communities. While the general level of need is likely to vary in 
different communities, the average Even Start family had three of the seven need 
indicators. Forty-two percent of all families had four or more need indicators 
and were identified as “very needy families” for the purposes of analysis. In 
other words, more than 40 percent of Even Start families experienced four or 
more of the following circumstances: being a single parent; having 9th-grade or 
lower education, limited English proficiency, annual income below $12,000; 
receiving government assistance; and/or raising four or more children, one of 
whom may have a disability. 

As a point of comparison, the 1996 federal poverty level for a family of four 
with two children was an annual income of $15,91 1. Many Even Start families 
have incomes far below $12,000 and have no educational experience beyond 
primary school. Thus, Even Start projects are indeed recruiting and serving very 
needy families with multiple disadvantages. 



Even Start Services 

In 1995-96, over half of the Even Start projects were located in rural areas; 35 
percent were in urban areas. In many communities, adult education as well as 
early childhood education programs for children ages 3 to 5 years were available 
through other auspices. However, family literacy programs, educational services 
for infants and toddlers, and parenting education were available in fewer than 
half of the communities. 
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Participant Recruitment 



Even Start projects are required to recruit families most in need of Even Start 
services. The need assessment must take into account families’ low income; 
parents’ limited educational experience, literacy skills, and/or English-language 
proficiency; and any other disadvantages that may exacerbate the families’ 
economic and educational needs. 

In general, projects used a wide variety of recruitment methods. Compared to 
newer project sites, the project sites with four or more years of experience 
employed more labor-intensive, personalized recruitment strategies such as 
telephone contacts, home visits, and “walking the neighborhood.” 

In recruiting participants, many projects target families with specific 
characteristics and needs. Criteria most often used for targeted recruitment were 
(a) parents with no high school diploma and (b) families with preschool-aged 
children. In 1995-96, the proportion of project sites targeting teen parents 
increased from 44 percent to 54 percent. On the other hand, relatively fewer 
projects (46 percent) used family incomes below specific levels as targeting 
criteria in 1995-96 compared to 1994-95 (56 percent). Judging from the 
pervasive poverty reported by program participants, projects may not need to 
specifically target low-income families in their recruitment efforts. 

Even Start Curriculum 

Even Start projects are required to provide participants with services in three 
core areas (adult basic or adult literacy education, parenting education, and early 
childhood education) as well as home-based instruction, parent-child joint 
activities, and support services. However, there is no single Even Start model. 

A majority of project sites designed their own educational programs, 
incorporating features of existing approaches. 

Across all educational components, projects commonly relied upon 
individualized instruction using curriculum materials externally developed by 
other programs. Group activities were more common in English as a Second 
Language (ESL), parenting education, and early childhood education than in 
adult basic education and adult literacy classes. Parenting education classes 
tended to be more learner-directed than all other educational programs. 

Projects reported incorporating functional literacy into their adult education 
programs more frequently in 1995-96 than in 1994-95, especially for 
intermediate and secondary level classes. Life skills and parenting topics were 
commonly used as contexts for adult education instruction, paralleling previous 
findings. The use of vocational topics in adult education increased slightly from 
the previous year. 

Parenting education was largely child focused. Topics covered by a majority of 
projects were: child development; the development of language and thinking, 
motor, and social skills; and ways to ensure a child's safety and well-being. 
Almost all projects included parent-child literacy activities as part of their 
parenting education curriculum. 
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Parent-child joint activities played an essential role in parenting and early 
childhood education. On average, in 1995-96 a family was offered three hours 
per month of structured parent-child activities through home visits; nine hours in 
a center-based environment; and five hours of special events such as field trips. 
Topics addressed through these activities included: reading and storytelling; 
language development exercises; child’s social development, independence, self- 
discipline, and self-help skills; health and nutrition; early academic skills; arts 
and crafts; sensory stimulation; and gross motor skills. 

The integration of instructional activities across the three core service areas is 
one of the key elements of Even Start. Parenting and early childhood education, 
as well as parenting and adult education, were most commonly integrated, 
usually through parent-child joint activities. 

To facilitate families’ participation in Even Start educational activities, projects 
provided a wide range of support services, either directly or through referrals. 

The support services most often received by Even Start parents and children 
were child care, transportation, family support (e.g., counseling and support 
groups), and meals. 

Amount of Educational Services Offered 

The hours of instructional services offered over the course of a program year by 
Even Start have increased over the three years from program year 1993-94 to 
1995-96. The hours of services offered in 1995-96 have increased by 
approximately three hours per month since 1994-95 for adult and early childhood 
education and by approximately one hour per month for parent-child joint 
activities. 3 In 1995-96, on average, 325 to 404 hours of adult education and 201 
hours of parenting education were offered per year per parent, depending on 
academic levels. Hours offered in early childhood education ranged from 391 to 
609 per year per child, depending on age groups. 

Reflecting the increased enrollment of teen parents, the percentage of project 
sites offering services to infants and toddlers has increased from 71 percent to 89 
percent since 1994-95, and the hours of instructional activities for infants and 
toddlers increased from an average of 350 hours per year to 391 . Project sites 
with higher percentages of teen parents offered more instructional hours in all 
core service areas than sites with fewer teen parents. Project sites serving high 
percentages of very needy families (with four or more of the seven need 
indicators) offered substantially more instructional activities than sites with 
lower percentages of very needy families. 

As expected, mature projects with four or more years of experience offered 
substantially more hours of service than the first-year projects across all 



3 The hours offered for parenting education have remained relatively constant since 
1993-94. Throughout this report, notable changes over time are described, while 
data that were fairly stable over time are mentioned only when the stability is 
noteworthy. 
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educational components. The differences due to project experience were most 
prominent in the service areas of beginning adult education and ESL, where 
mature project sites offered sixty-nine and 109 more hours per year, respectively, 
than did first-year projects. 



Extent of Participation by Families 

It is important to distinguish between services offered by projects and 
participants’ rates of participation. In 1995-96, 85 percent of Even Start parents 
participated in adult education, for an annual average of 1 14 hours per 
participant. This translates into between eleven and twelve hours per month 
when calculated on a ten-month educational calendar. Teen parents were the 
most active participants in adult education programs (147 hours average), a 
dramatic increase from the previous program year (ninety-one hours average). 
Adult secondary education, GED preparation, and ESL were the most commonly 
attended adult education programs. 

In 1995-96, 88 percent of parents participated in parenting education, receiving 
an annual average of twenty-seven hours of instruction. Older parents spent 
more time in parenting education than teen parents. 

Ninety-five percent of children participated in early childhood education 
services, most commonly in organized, center-based programs and 
individualized, home-based programs. Other types of programs attended by 
substantially smaller percentages (approximately 20 percent) of children 
included Even Start services coordinated with compulsory education programs 
and day care services offering educational activities. (Of the 5 percent of the 
children who did not participate in early childhood education, 80 percent were 
eligible according to age criteria, but they may well have enrolled in the program 
shortly before the evaluation reporting deadlines.) Nearly one-third of children 
participated for only one to three months (including children who enrolled close 
to the end of the evaluation year). About one-fourth of children participated for 
ten to twelve months. The majority of participating children attended most of 
the time while they were participating. 

The number of hours of participation by parents was directly related to the 
number of instructional hours projects provided. Parents enrolled in projects 
that provided more than 453 hours per year of adult education participated 
substantially more (139 hours per year) in adult education services than parents 
in projects offering 240 or fewer instructional hours. (The top 25 percent of 
projects offered 453 or more hours of adult education per year; the bottom 50 
percent offered 240 or fewer hours.) Similarly, parents in projects offering more 
than 240 hours of parenting education (top 25 percent of projects) spent more 
hours in parenting education — an average of forty-two hours — than parents in 
projects offering fewer hours of parenting education. 
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Retention and Reasons for Leaving 

Sixty percent of families new to Even Start in 1995-96 were retained at the end 
of the year; 6 percent had completed their educational goals and left the program. 
Thus, approximately two-thirds of families continued participation or had 
successfully completed the program. 

Families headed by parents with very low or very high educational backgrounds 
had higher rates of retention/completion than families in which parents had 
intermediate or some high school education. A higher percentage of families 
with parents in their 30s and 40s were continuing or had completed their goals 
compared to families with younger parents. Fourteen percent of families 
terminated due to a combination of factors such as poor attendance, lack of 
interest, and family problems. 



Services Provided to the Neediest of Even Start 
Families 

Despite their multiple disadvantages, the very needy families (those having four 
or more of the seven need indicators) participated in Even Start educational 
services as much as, or more than, the less needy families. A slightly higher 
percentage of very needy families participated in all three core services (77 
percent to 79 percent) than families with zero to two needs (75 percent). 

Further, parents in very needy families spent substantially more hours in adult 
and parenting education than did parents in families with two or fewer need 
indicators. Children in very needy families participated in early childhood 
education as much as their peers from less needy families. 

However, at the end of the 1995-96 program year, a larger percentage of less 
needy families were still enrolled or had completed their goals (71 percent) 
compared to very needy families (66 percent). 



Resources Supporting Even Start Services 

The patterns of funding at the project level appear to be shifting toward 
increasing contributions of local funds supporting Even Start services. This is 
consistent with the legislation, which stipulates that the portion of the total 
budget supported by Even Start funds must decrease 10 percent each year. This 
means that the non-Even Start (“local”) matching funds must increase 
correspondingly and constitute at least 40 percent of annual operating budget by 
year four. Further, projects that receive a subsequent grant or grants must obtain 
at least 50 percent of their budget from local sources in all years of these grants. 
Aside from funding patterns, many aspects of program operations have remained 
largely unchanged over the past several years, including project staffing, 
interagency collaboration, and issues that present challenges for program 
implementation. 
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Program Funding 



With all federal, state, and local resources combined, the average annual budget 
for Even Start projects in 1995-96 was $245,273, nearly $19,000 per project less 
than in the previous program year. However, based on data reported by 84 
percent of all projects, the average project in 1995-96 received $108,718 in local 
contributions, $21,557 more than the 1994-95 average of $87,161. 

With all types of funds combined, the amount that projects spent per family has 
increased each year since 1993-94, from $3,709 in 1993-94 to $4,438 in 1995- 
96. Further, focusing only on the federal share, the dollar amount spent per 
family has remained remarkably stable at approximately $2,700 across the three 
years. 

These results seem to reflect, at least in part, the combined effects of two trends: 
(1) a slight reduction in the average number of families served by each project 
(from sixty per project in 1994-95 to fifty-five in 1995-96) and (2) an apparent 
increase in the amount of local contributions. The smaller project size is 
consistent with reports from many project directors that they are devoting greater 
efforts and resources per family to enhance program effectiveness, rather than 
simply increasing the number of participants. The increase in the local 
contributions also seems consistent with a larger number of projects receiving 
the second four-year grants and supporting at least 50 percent of their budget 
with local matching funds. In 1995-96, roughly 37 percent of projects were in 
their second grant cycle. 

In submitting fiscal data for the national evaluation, some projects may have 
underreported the amount of local contributions due to omissions of some in- 
kind resources. However, the apparent shifts in the relative shares of federal and 
local funds and the increasing per-family budget also may reflect a gradual 
maturing of Even Start both programmatically and in conformance with the 
legislation. 



Even Start Staff 

The staff composition of Even Start projects has not changed appreciably since 
1993-94. The average project in 1995-96 had a staff of ten Even Start-paid 
persons that included one project administrator, three to four teachers, one to 
two teachers’ aides, one family specialist, one support service provider, one 
evaluator, and one administrative support person. Seventy-eight percent of the 
Even Start-paid instructors had at least a bachelor’s degree; 25 percent had a 
master’s degree. Ninety-four percent of aides had at least a high school diploma 
or GED, and 10 percent had a four-year degree. Over half of all Even Start 
instructors had six or more years of teaching experience. On average, in 1995- 
96, Even Start staff received five to eight days of inservice training, depending 
on job category. 
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Interagency Collaboration 

Even Start is intended to serve as the “glue” that facilitates coordination of 
existing services and resources in the community to provide education to low- 
income families. Projects are succeeding in developing a wide network of 
collaborative arrangements. The contribution of collaborating agencies in Even 
Start instructional programs was most prominent in adult education. For 
approximately one-third of project sites, collaborating agencies were solely 
responsible for providing educational services in all levels of adult education; 
Even Start and collaborating agency staff shared responsibilities in about one- 
quarter of project sites. Public school departments (other than the specific 
departments sponsoring Even Start) on one hand, and colleges and universities 
on the other, served as primary providers of adult education services for 35 
percent and 19 percent of project sites, respectively. 

For parenting education services, which are less commonly available than adult 
education programs in most communities, a majority (63 percent) of project sites 
relied solely on Even Start staff to deliver services. Agencies serving as 
secondary providers of parenting education included: community groups (56 
percent); public school departments (51 percent); government agencies (51 
percent); and Head Start (49 percent). 

Even Start resources were used exclusively for serving infants and toddlers in 68 
percent of project sites, while collaborating agencies played a greater role in 
serving older children. Some projects relied on instructors from public school 
departments (34 percent), Head Start (24 percent), and other preschool and 
daycare programs (17 percent) as primary service providers. 

Thus, while a variety of agencies and organizations collaborate with Even Start 
projects, Even Start staff tend to provide direct services in educational areas that 
are less frequently served by other sources in the community. Project directors 
have reported high levels of satisfaction with their collaborative arrangements 
since 1993-94. 

Challenges in Program Implementation 

As in the previous two years, the major challenges to program implementation 
were improving attendance; improving participants' retention or motivation; 
obtaining sufficient financial resources; and obtaining adequate transportation. 

The two areas for which the projects indicated a great need for technical 
assistance were funding or fiscal issues and increasing participant involvement 
and retention. More than half the projects experienced some need for technical 
assistance in areas such as staff development; increasing participant involvement 
and retention; funding; balancing program resources between educational and 
support services; and handling the social or health problems of participants. 
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Educational and Developmental Outcomes of Even 
Start 



The purpose of the Sample Study is to relate participation in Even Start services 
to specific, measurable educational and developmental outcomes for both adults 
and children. As in the first evaluation, the Sample Study measures three types 
of educational/developmental outcomes: child cognitive development, adult 
education, and parenting. However, the second evaluation does not include a 
control group, and program outcomes are assessed in terms of the differences 
between participants’ pretest (i.e., pre-Even Start) and posttest scores on a battery 
of standardized tests. 

The outcomes for Even Start participants are based primarily upon data from 
those participants who remained in Even Start long enough to participate in at 
least two rounds of data collection. 4 When we contrasted demographic and other 
characteristics of families for those with only pretest data versus those with both 
pretest and posttest data, however, we observed systematic differences between 
the two groups. Essentially, families with more complete data are more likely, 
on average, to be employed, have higher incomes, speak languages other than 
English at home, and have completed more schooling. This means that the 
results we describe in this report — based upon participants who remain in the 
program — are biased. This critical caveat should be held in mind when 
reviewing the discussions about educational and developmental outcomes. 

In the domain of child cognitive development, children in both the first and 
current evaluation achieved significant gains on the PreSchool Inventory (PSI), a 
test for school readiness skills. We report gains in standard deviation units in 
order to describe the relative magnitude of gains between pretests and posttests 
across different outcome measures. The standard deviation provides a measure 
of the variability of the distribution of scores on a particular measure (e.g., 
whether the scores vary widely across the full range of possible scores or 
whether the scores are clustered more tightly). The standardized gain score is 
calculated by dividing the gain score (or the difference between the pretest and 
posttest) by the standard deviation of the pretest. 

Across both the 1994-95 and 1995-96 program years, Even Start children gained 
nearly one standard deviation in the approximately six months between pretest 
and posttest assessments. Even Start children in 1994-95 and 1995-96 also made 
significant gains, slightly over half of a standard deviation, on the Preschool 
Language Scale-3 (PLS-3) used to measure language development. 



4 For the purposes of characterizing baseline status on several outcome measures, 
however, we do report pretest or entry scores for participants for whom we may not 
necessarily have posttest or followup scores. This allows us to estimate the degree of 
comparability between participants who do and do not remain in the Even Start 
program. 
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The educational progress for adults was more moderate, on average, than gains 
observed for the children participating in Even Start. Adults were assessed with 
either the Comprehensive Adult Student Assessment System (CASAS) or the 
Tests of Adult Basic Education (TABE) in both reading and math subject areas. 
Across both the 1994-95 and 1995-96 program years, adults made gains on these 
measures. For those assessed with the CASAS, the standardized gain score from 
pretest to posttest was .24 for reading, and .44 for math. For those assessed with 
the TABE, the standardized gain score was approximately .25 for both reading 
and math. The gains observed on the CASAS are comparable to those in the first 
national evaluation of Even Start and in other adult education programs. (The 
TABE was not used in the first four-year evaluation of Even Start.) 
Approximately 10 percent each of adults in the Universe and Sample Study 
attained a GED certificate while participating in Even Start. 

In addition to educational assessments for children and adults, the outcomes 
included a measure of the home environment, called the Home Observation for 
Measurement of the Environment (HOME) Screening Questionnaire. The 
HOME measures the quality of cognitive stimulation and emotional support 
provided to the child(ren) by the family. Parent posttest scores on the HOME 
Screening Questionnaire (HSQ) showed moderate gains for parents of children 
in two age groups: those with children from birth to 3 years of age and those 
with children between 3 and 6 years of age. 

While the second Even Start evaluation does not include a control group, a 
control group of low-income families participating in a national evaluation of 
another federally-funded "two-generation, family support" program showed no 
change in HSQ scores over time. This finding suggests that there is no "normal" 
or "developmental" growth associated with this measure. This further suggests 
that the positive changes seen among Even Start families are due to the program 
rather than to other factors. 

Additionally, the Sample Study component of the second evaluation, unlike the 
In-Depth Study (IDS) component of the first evaluation, depends upon local 
projects to administer child and adult tests and collect and submit data on 
outcome measures. Sample Study project staff were initially trained in August 
and September of 1994. Although there have been no other meetings for the 
Sample Study projects, the projects received refresher training manuals in 
September 1995 and September 1996. While many projects have worked hard to 
ensure that annual data submissions are completed and accurate, the quality of 
data submitted by the local projects has been extremely variable. We believe 
this is due to a combination of factors, including changes in testing and 
administrative personnel at the project level. 'As a result, we believe we must 
interpret our findings with considerable caution because the data may not reflect 
participants’ performance as accurately as we had hoped. 

Also, the Sample Study, like the IDS, was intended to collect data at three points 
in time: at pretest, at posttest (at the end of a participant’s first full program 
year), and at another posttest at the conclusion of the following program year, in 
order to assess the impact of participation in Even Start over a longer time 
period. What we have learned, however, is that most participants in the Sample 
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Study participate in Even Start long enough for project staff to collect at least 
pretest data and often posttest data, but only about 10 percent of the Sample 
Study participants are still enrolled in Even Start at the time of the second 
posttest. As a result, while we can assess changes in performance from pretest to 
the first posttest for a majority of Sample Study participants, our estimates of 
changes from the pretest to the second posttest are based upon a potentially 
biased subsample of participants (e.g., those 10 percent or so of participants still 
enrolled in the program). 



Factors Associated with Program Outcomes 

Over the past two years, we have collected data on a number of outcome 
measures for children and adults participating in Even Start. The overall results 
reflect the same trend from year to year: on average, participants make gains 
from pretest to posttest, and the observed gains for children are larger than those 
for adults. This is consistent with what has been found in other studies. 

What is more puzzling, however, is that the relationships between the amount of 
instruction received, participant and project characteristics, and outcome 
measures indicate few clear trends or directions. In the first national evaluation, 
for example, there was an observed relationship between service intensity and 
educational outcomes for children and adults (e.g., the greater the level of 
participation in Even Start services, the greater the increase in children’s gains on 
the the PPVT). During the first year of the current national evaluation, while 
there were some relationships between service intensity, such as hours of adults 
education or parenting education, and outcomes such as adult scores on the 
CASAS, TABE (math only), or the HSQ, the data from the 1995-96 program 
year, however, do not indicate any consistent relationship between service 
intensity and educational outcomes. Because the relationships are inconclusive 
and in fact differ somewhat across years, we can only report that despite the 
gains participants clearly made on all the outcome measures, the reasons for 
those gains have yet to be explained. 



Conclusions 

The 1995-96 national evaluation of the Even Start program confirmed that many 
characteristics of program participants and program operations have stabilized 
over the last several years. At the same time, in the generally familiar patterns of 
findings, there are signs of changes that may unfold in the coming years. The 
evaluation findings point to areas in which projects are making visible progress 
as well as issues that call for continued effort and improvement. 

The most important mandate for the program is to serve the families most in 
need of its family educational services. The annual evaluations have repeatedly 
confirmed that Even Start serves highly disadvantaged families. In addition, 
there are indications that the need levels of participants may be increasing. 
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Compared to prior years, for example, a larger percentage of the 1995-96 
enrollees were receiving government assistance. 

Another trend is the increasing enrollment of teen parents. Many teen parents 
live in extended families and may have the economic and social support that 
extended families could provide. At the same time, many of them are single 
parents, lack a high school diploma, and have limited experience as self- 
sufficient adults. The extended households of many teen parents may pose a 
new challenge to provide educational services that account for the strengths and 
difficulties associated with three-generation families. 

The evaluation revealed several signs that projects are striving to respond to the 
changes in participant profiles and needs as well as to the shifting political and 
programmatic environments. With the increase in the number of projects 
targeting teen parents, a large majority now are offering educational programs 
for infants and toddlers. This level of early childhood education is not 
commonly available in most communities, and Even Start clearly fills a need for 
infant and toddler services in many projects’ communities. 

For the past three years, the levels of educational services offered to Even Start 
families have increased in all service areas. In 1995-96, more projects were 
incorporating vocational education materials in their adult education curricula 
than in earlier years. Moreover, projects with higher percentages of very needy 
families and/or teen parents offer substantially more hours of educational 
services compared to other projects. In response, the very needy families tend to 
participate in these services as much as or more than less needy families, despite 
their multiple disadvantages. Teen parents are also the most active participants 
in adult education. 

Although the projects are succeeding in recruiting and serving some of the most 
at-risk families in their communities, the retention/completion rates of very 
needy families and teen parents lag slightly behind other Even Start families. As 
in other educational programs targeting low-income learners, participant 
motivation and retention are two of the most difficult challenges in Even Start 
service delivery. The rates of unsuccessful termination from the program were 
higher among the very needy families and families with teen parents. 

As welfare reform initiatives are implemented across the nation, the demands 
and expectations placed on Even Start and other family education programs may 
grow. Even Start may become an avenue for families to end long-term 
dependence on government assistance. On the other hand, welfare reform could 
discourage enrollment by families eligible for Even Start. The urgency to find 
and keep employment may interfere with or even prevent some families from 
pursuing long-term goals of family literacy programs. The percentage of 
families leaving the program without completing their goals due to new 
. employment preventing continued participation may increase. Maximizing 
opportunities for interagency collaboration, ensuring the availability of support 
services to enable the very needy families to participate, and accommodating 
more to the schedules and needs of working parents are areas that need 
continued innovation and improvements. 
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Some changes in project characteristics seem to reflect the overall maturation of 
the Even Start program as a whole. Although nearly 20 percent of all projects 
were in their first year of operation, almost 40 percent had four or more years of 
experience. The increasing percentage of mature projects contributed to sizable 
gains in the amount of instructional activities they offered to participants — in 
every level of adult, parenting, and early childhood education services. The 
level of services offered was greater among projects with four or more years of 
experience, showing a promising course of growth for new projects. 

While many aspects of program operations are less developed among the first- 
year projects, by the time projects complete their second year, they tend to 
achieve a level of implementation comparable to projects with many more years 
of experience. The generally quick program implementation process may signal 
increasing efficiency and quality of technical assistance provided to new projects 
by state coordinators and other sources. The dynamics of factors and processes 
contributing to project maturation present fruitful areas for future research. 
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Chapter 1: Introduction 



The Even Start Family Literacy Program addresses the basic educational needs 
of parents and children of low-income families. This national program was 
designed to provide adult, parenting, and early childhood education as integrated 
services to families. Even Start offers (1) adult education and literacy programs 
for parents; (2) early childhood education for the children of these parents; and 
(3) parenting education to assist parents in actively and effectively promoting 
their children’s development. 

Since its inception in 1989, the program has undergone significant changes. The 
number of projects has grown from seventy-six projects in 1989 to more than 
570 in 1996. In 1992 the primary responsibility for program administration was 
transferred from the U.S. Department of Education to the individual states. 

While a steady stream of new Even Start projects has joined the program each 
year, some mature projects reached their seventh year of operation in 1996. 

To monitor development of this program, the law that authorizes Even Start 
mandates an evaluation of all Even Start projects. Information collected 
annually provides performance feedback that is useful to local projects, state and 
federal administrators, legislators, and policymakers for program improvement 
and policy development. This information also contributes to the knowledge 
base on the effects of family literacy programs by investigating the relationships 
between program processes and outcomes. 

The first national evaluation documented the program’s development during 
1989 to 1993 and provided the early, short-term assessment of its effectiveness 
(St.Pierre et al., 1995). The current national evaluation covers the four 
subsequent program years, 1993 to 1997. 



The Even Start Program: Legislation and Administration 

The Even Start Program was authorized by the Elementary and Secondary 
Education Act of 1965 (ESEA), as amended by the Hawkins-Stafford 
Elementary and Secondary School Improvement Amendments of 1988, Part B of 
Chapter 1 of Title I (P.L. 100-297). The Even Start legislation was amended in 
July 1991, when Congress passed the National Literacy Act (P.L. 102-73). In 
1994, the Even Start program was reauthorized by the Improving America’s 
Schools Act as Part B of Title I of the ESEA. 1 According to the 1994 legislation, 
the Even Start program is intended to: 



Even Start projects were required to implement in program year 1995-96 the changes 
made by the 1994 reauthorization law. 
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"...help break the cycle of poverty and illiteracy by improving 
the educational opportunities of the Nation’s low-income 
families by integrating early childhood education, adult literacy 
or adult basic education, and parenting education into a unified 
family literacy program ....The program shall (1) be 
implemented through cooperative projects that build on existing 
community resources to create a new range of services, (2) 
promote achievement of the National Education Goals, and (3) 
assist children and adults from low-income families to achieve 
to challenging State content standards and challenging State 
student performance standards." (P.L. 103-382, Sec. 1201) 2 

To be eligible for Even Start in 1995-96, a family needed (a) a parent who was 
eligible for adult education services under the Adult Education Act or who was 
within the state’s compulsory school attendance age range and (b) a child under 
8 years of age. Beginning in 1995-96, more teen parents became eligible for 
Even Start. This new participant group included teen parents — either under or 
over age 16 — within a state’s compulsory school attendance age range, as long 
as a local educational agency provides for the basic educational services for 
these parents. 3 

Even Start began as a federally administered program in fiscal 1989, with grants 
totaling $14.5 million awarded to seventy-six projects. The fiscal 1991 funding 
rose to $49.7 million. According to the Even Start statute, when program 
funding reached $50 million, the program was to be administered primarily at the 
state level. In 1992, with the federal appropriation for 340 projects exceeding 
$70 million, the program administration was assumed for the most part by the 
states. 

Most Even Start projects now are state administered. Each state receives 
funding based on the relative proportion of funds it receives under the Title I 
allocation formula. States hold grant competitions and make subgrant awards. 
The statute specifies that each Even Start subgrantee receive a minimum of 
$75,000 per year, except for one subgrantee per state that may receive less. 

Family literacy programs specifically for migrant families, Indian tribes and 
tribal organizations, and insular areas are supported through special set-aside 
funds (5 percent of the total Even Start allocation) and remain under federal 
administration. These funds support the implementation of the Even Start family 
literacy approach tailored for groups of participants with special circumstances. 
Since 1993-94, approximately ten to twenty each of Migrant Education Even 
Start (MEES) and tribal Even Start projects have been funded each year. 



2 A full text of the Even Start legislation appears in Appendix A. 

3 Prior to this change regarding eligibility of teen parents, Even Start could only serve 
families headed by teen parents at least 16 years old or beyond the age of compulsory 
school attendance who were not attending school. 
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MEES projects serve a highly mobile population — families moving across 
several states each year. In addition to economic and educational limitations 
common to all Even Start families, many migratory parents and children are 
recent immigrants and are limited in English language proficiency. The MEES 
educational services need to account for a great diversity in language and 
cultural backgrounds of participants. One of the major challenges for MEES 
projects is to design and deliver meaningful educational services to families who 
may be in their programs for only a few months before moving. Some MEES 
projects are designed to follow the same families across states over time; others 
focus their efforts on families only while they are in their communities. 

Tribal Even Start projects experience a different set of special challenges. 
Families tend to be stable geographically but may be widely scattered in remote, 
rural areas. In these areas, families’ access to educational and support services 
provided by other community organizations may be limited. For these reasons, 
some tribal projects rely mainly on home-based educational services. While 
these circumstances may be common to many rural projects, incorporating 
materials and activities that are consistent with and promote the Native 
American heritage is an important objective of many tribal Even Start projects. 

In addition to the MEES and tribal projects, discretionary grants for statewide 
family literacy initiatives and a family literacy project in a prison that houses 
women and their preschool-aged children are authorized. These projects also are 
funded and administered directly by the U.S. Department of Education. 



Principal Components of the Even Start Approach 

The underlying premise of Even Start is that combining adult literacy or adult 
basic education, parenting education, and early childhood education into a 
unified family literacy program offers promise for helping to break the 
intergenerational cycle of poverty and low literacy in the nation. The Even Start 
program has three interrelated goals: 

■ To help parents improve their literacy or basic educational skills; 

■ To help parents become full partners in the education of their children; and 

■ To assist children in reaching their full potential as learners. 

Exhibit 1.1 presents a conceptual model that describes the types of activities 
conducted by Even Start projects; input factors that are believed to influence the 
design and delivery of services; and the intended outcomes for participating 
parents and children. Even Start services provided to children and their parents 
can be grouped into two areas: (1) core educational services and (2) support 
services. The core services have three components, as specified in the 
reauthorization legislation: 
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b Adult education and adult literacy: high-quality instructional programs 4 
for adults to promote adult literacy [including adult basic education (ABE), 
adult secondary education (ASE), English as a second language (ESL), and 
preparation for the General Education Development (GED) certificate]; 

b Parenting education: high-quality instructional programs to empower 
parents to support the educational growth of their children; and 

a Early childhood education: developmentally appropriate educational 
services for children designed to prepare them for success in regular school 
programs. 

In addition to core services, Even Start projects typically provide a range of 
support services, some of which are designed to facilitate provision of core 
services. Examples of support services are transportation, child care, health 
care, meals, nutrition assistance, mental health referrals, referrals for 
employment, advocacy assistance with governmental agencies, counseling, child 
protective services, referrals for screening or treatment for chemical dependency, 
referrals for services to battered women, special care for a disabled family 
member, and translators. The Even Start legislation requires that support 
services be obtained from existing providers whenever possible to ensure that 
Even Start projects avoid duplication of services. 

Even Start is intended to benefit families in several domains. While not every 
Even Start project will try to affect all of the outcomes listed in Exhibit 1.1, 
potential program outcomes for parents include positive changes in literacy 
behaviors (e.g., shared literacy events with children and increased reading and 
writing activities in the home); parenting behavior and skills (e.g., positive 
parent-child relationships and positive expectations for child); and educational 
and employment skills (e.g., improved reading and English language ability and 
higher educational attainment). Goals for Even Start parents also may include 
growth in personal skills and community involvement. The potential positive 
impact of Even Start on children includes improved school readiness and 
achievement. Once children enter school, outcomes might include satisfactory 
school performance, improved school attendance, and a lower incidence of 
special education, and retention in grade. 



4 In April 1996, the Even Start statute was amended to require high-quality, intensive 
instructional programs. This requirement became effective for projects in program 
year 1996-97. 
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Exhibit 1.1: Even Start Conceptual Model 
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While setting forth major elements required for all Even Start projects, the Even 
Start legislation allows grantees great flexibility in designing services to meet 
local needs. The model reflects the differentiation among local projects across 
many dimensions. These include: 

s The characteristics of target children and adults; 

h The collaboration strategy to coordinate service delivery with other 



b The extent to which services for families are integrated (e.g., activities in 
parenting education reinforcing learning in adult education); 

ii The use of an existing educational model and materials for delivering early 
childhood and adult basic education services; 

h Strategies for recruiting and retaining program participants; 

n The role that parents play in the project; and 

b Staff development activities. 



The Even Start legislation requires a number of key elements and features to be 
implemented in all local projects. They include serving families most in need of 
Even Start services; providing three core services (adult, parenting, and early 
childhood education), support services, and home-based services to participants; 
integrating educational activities across the three core areas; coordinating service 
delivery with other existing programs; and conducting local evaluations. 

While the legislation tells projects what to do, decisions regarding how to 
implement each requirement are left up to the projects. While the legislation 
requires high-quality, intensive instructional programs, projects decide on the 
frequency and duration of program activities, whether the activities are primarily 
center based or home based, and whether to invent educational curricula from 
scratch or use a hybrid of existing approaches. Projects decide which program 
components will be paid by Even Start funds and which components will be 
supported by collaborating agencies. 

The number and characteristics of program participants vary greatly across 
projects, depending on such factors as geographic location, economic and social 
characteristics of local population, and the specific design of the project. On 
average, each Even Start project serves approximately sixty families each year. 
However, some large projects in highly populated urban areas enroll several 
hundred families, while small rural projects may serve twenty to thirty families 
per year. 

Overall, Even Start families are very poor; 70 percent have annual incomes 
below $12,000 (with an average household size of five or six persons). In terms 
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of parents’ educational backgrounds, a majority of parents enter Even Start 
lacking a few years of high school education. However, about 40 percent have 
only primary school education. Many parents are not native English speakers 
and have very limited English language abilities. 

Projects can decide to focus educational activities for children on a narrower age 
span than the birth-to-eight year range allowed by the legislation as long as each 
project, at a minimum, targets children of a three-year age range. Since the Even 
Start program began, local projects have consistently offered services for 
preschool-aged children. Services for infants and toddlers, initially offered less 
frequently, are now available in many more projects. 

Most Even Start projects provide, either directly or through collaboration with 
existing early childhood programs such as Head Start, a center-based early 
childhood program. These center-based programs usually incorporate elements 
of pre-existing curricula designed for young children. School-age children 
through age 7 Even Start services that often are provided in conjunction with 
their compulsory education activities. Such services may take the form of 
homework assistance given in before- and after-school child care programs and 
summer school activities. 

Adult education services are provided in a variety of formats by different levels 
of trained personnel, ranging from volunteers to certified adult education 
teachers. Some projects offer adult education classes geared toward completing 
a GED, while others provide general instruction in basic skills such as reading, 
writing, and math. In some projects, adult education services are focused chiefly 
on English as a second language curriculum. Projects working with adults who 
have very low-level basic skills may arrange individual tutoring through Literacy 
Volunteers of America (LVA) or provide other types of one-on-one instruction 
during home visits. 

Parenting education is less frequently available through other sources than are 
adult and early childhood education programs. Thus, many projects rely mostly 
on Even Start resources to deliver parenting education services. These services 
may take the form of group discussions, hands-on activities, home visits, and 
presentations by invited speakers. Topics addressed in these activities include 
helping families make use of available community services, increasing parents’ 
understanding of their role in their children’s education, and training parents in 
child-behavior management. 

Educational activities are often offered in institutional settings (e.g., adult 
education classes in high schools and community colleges and preschool 
programs associated with community-based organizations or local education 
agencies). In some projects, however, particularly those in sparsely populated 
rural areas, Even Start services may be home based, involving highly 
individualized instruction tailored to each family’s needs. 

Projects vary greatly in the amount of experience in operating the Even Start 
program. Some projects began with relevant prior experience in providing 
family educational services and have further refined and enhanced their services 
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over four or more years of Even Start grants. In 1995-96, nearly 40 percent of 
projects had more than three years of Even Start experience. On the other hand, 
every year about 15 percent of projects are new Even Start grantees. Commonly, 
new grantees spend six months or more in program development before they 
begin enrolling families and even more time before all key program elements are 
in place. 



Organization of the Report 

This is the third Interim Report under the current Even Start national evaluation. 
Chapter 2: Even Start National Evaluation describes the components of the 
previous and current national evaluations, followed by more detailed information 
on the research questions being addressed in the current evaluation. 

Program year 1995-96 was the second year under this evaluation in which 
information on participating families was collected. Chapter 3: Who Are the 
Even Start Families? presents detailed descriptions of the families, parents, and 
children who participated in Even Start during 1995-96. Following this 
introduction to the participating families, Chapter 4: What Services Do Even 
Start Projects Provide to Participants? extensively describes educational and 
support services Even Start projects offered to the families. 

To distinguish between the services projects offer and the services in which 
families participate, Chapter 5: To What Extent Did Even Start Families 
Participate in the Services Offered? reports participation rates for parents and 
children in all components of the educational services. We also examine more 
closely the neediest of Even Start families in Chapter 6: What Services Are 
Provided to the Neediest of Even Start Families? It presents focused analyses of 
very needy families and the extent of their participation in Even Start. 

Program year 1995-96 also was the second under this evaluation in which data to 
assess the effectiveness of the Even Start program were collected. Findings on 
participant progress over two years are presented in Chapter 7: What Are the 
Educational and Developmental Outcomes of Even Start Participants? Chapter 
8: Do Program Outcomes Vary Depending on Project and Participant 
Characteristics? expands on the preliminary findings reported in the 1994-95 
report concerning the potential influence of various project characteristics and 
service delivery practices on participants’ educational progress. 

Finally, in Chapter 9: What Resources Support the Even Start Services? we 
return to project-level information. While Chapter 4 describes the nature and 
intensity of services offered to participants, Chapter 9 documents the 
administrative context of Even Start projects, levels of funding, staffing patterns, 
problems or challenges to implementing Even Start services, and issues for 
which projects need technical assistance. 
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Chapter 2: Even Start National EvaujatiosW^, 



Section 1209 of the reauthorized Even Start legislation requires an independent 
evaluation of the projects funded under Even Start to: 

1) determine the performance and effectiveness of programs ... 
and 

2) identify effective Even Start programs ... that can be 
duplicated and used in providing technical assistance to 
Federal, State, and local programs. 

In addition, each Even Start project is required to conduct an independent local 
evaluation. 



The First Even Start National Evaluation 



In January 1990, the U.S. Department of Education awarded the first contract for 
a national evaluation of Even Start. The evaluation, completed in April 1994, 
was based on the National Evaluation Information System (NEIS), which 
compiled data from all Even Start projects and an In-Depth Study (IDS) of ten 
projects. 

The NEIS was designed to collect a common set of data from each Even Start 
project and Even Start participants. The NEIS provided annual descriptive 
information about Even Start, including types of projects funded, services 
offered, collaborative efforts undertaken, and obstacles to program 
implementation. It also provided detailed information describing the families 
participating in Even Start, the services they received, and the progress they 
made in areas such as adult basic skills, children’s school readiness, and parent- 
child interactions. 



The second component of the first evaluation, the In-Depth Study, was designed 
to complement the broad-based NEIS data collected from all Even Start projects 
with detailed information from a subset of ten purposively selected grantees. 

The IDS focused on the short-term outcomes of Even Start on adults and 
children. Five of the ten projects implemented a design where families were 
randomly assigned to Even Start or a control group. Major findings from the 
first evaluation were summarized in the final report published in 1995 (St. Pierre 
et al., 1995). 



The first national Even Start evaluation documented the nature of program 
services and the types of families served by the program. From 1989-90 to 1992- 
93, federal funding for Even Start increased from $14.5 million to $70 million, 
and the program grew from seventy-six projects serving 2,500 families to 340 
projects serving 16,518 families. Data showed that the program achieved its 
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goal of working with families “most in need” of Even Start services — 79 percent 
of adults had not completed high school when they entered the program, and 66 
percent of families had annual incomes under $10,000. Though there was great 
project-to-project variation in most aspects of Even Start, virtually all Even Start 
projects were able to design and offer the three required core instructional 
services of adult education, parenting education, and early childhood education. 
They also offered instructional services in a home-based setting, services to 
parents and children together, and appropriate support services that enabled 
families to participate fully in Even Start’s core services. 

Outcomes for children followed a pattern seen in other studies of preschool 
programs: early positive effects on cognitive development that diminish over 
time once control group children start to receive school-based services. 

Similarly, the pattern of outcomes for adults was consistent with what has been 
learned from other studies of welfare-to-work programs: Even Start projects 
were able to increase rates of GED attainment but with no commensurate 
increase in functional literacy. While acquiring a GED may be an important 
stepping-stone to future education or employment, it is discouraging that literacy 
skills did not appear to improve at the same time. Finally, Even Start families 
that were intensively engaged in core services did better than families with lower 
levels of participation. 



Current National Evaluation 

In March 1994, the U.S. Department of Education awarded the second national 
evaluation contract. This evaluation consists of four related but distinct 
components: 

■ The Even Start Information System (ESIS) to collect data from all projects; 

■ The Sample Study to collect outcome data from approximately fifty-seven 
selected projects; 

■ Site visits to Migrant Education Even Start projects; and 

■ Site visits to Even Start projects for Indian tribes and tribal organizations. 

This four-year study continues to monitor the implementation and effectiveness 
of the Even Start program through analyses of the same critical issues examined 
in the first evaluation. In addition to the national Even Start evaluation, other 
studies of Even Start funded both by the U.S. Department of Education and other 
organizations are examining various specific issuer affecting the Even Start 
program. In addition, all local Even Start projects arrange for evaluations of 
their projects by independent evaluators. 
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Research Questions 



The current national evaluation addresses four major questions listed below, 
each associated with a set of more specific sub-questions. 




/. Who is served by the program? What services do they receive? Is the 
program reaching the appropriate target population? 

■ What are the characteristics of family units participating in Even Start? 



■ What are the background characteristics of adults who participate in Even 
Start (e.g., gender, age, race/ethnicity, employment status, annual income, 
primary language)? 

■ What is the educational history of adults who participate in Even Start? 
What percentage of adults enter with a high school diploma or a GED and 
what are their characteristics? 



■ What are the background characteristics of children who participate in Even 
Start (e.g., gender, age, race/ethnicity, special needs)? 

■ What are the program participation histories of children who participate in 
Even Start? 

■ How do the characteristics of Even Start adults compare with the 
characteristics of participants in adult education programs nationally? 

■ How do the characteristics of Even Start children compare with the 
characteristics of participants in Title I and Head Start programs? 

■ How do background and literacy characteristics of adults and children vary 
across projects? Is it possible to identify sets of projects that appear to be 
using different targeting criteria? Do some projects appear to target "high 
need" populations while others target "low need" populations? 

■ How many families participate in Even Start? In each of Even Start’s three 
core services? In all core services? 




■ How long do families participate in Even Start on a program-year basis (how 
many months are services received)? 

2. How is the federal funding spent on the program ? How many of the 
projects are well implemented? 

■ What is the geographic and urban/rural distribution of Even Start projects? 

■ What is the federal cost for Even Start projects? What services are 
purchased with Even Start funds? 

■ How are families recruited into Even Start? How do projects target 
recruitment efforts? 



■ What local evaluation activities are being undertaken by Even Start projects? 
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■ What is the nature of services in early childhood education, adult education, 
and parenting education offered by the project? What activities does the 
project offer for parents and children together? What is the nature of home 
visits offered by the project? What types of support services are provided to 
participants? 

■ What types of collaborations exist between Even Start and other agencies? 
What types of agencies are collaborators? 

■ What is the training and experience of staff who provide Even Start 
services? 



■ How long do Even Start families stay in the program? 

■ What barriers exist to successful program implementation? 



■ Are the differences in program implementation associated with such factors 
as project cohort, length of time the project has had a grant, and area of the 
country? 




How well does the Even Start basic model work? Do participants perform 
better on key measures than similar persons who do not participate? 



■ What gains are observed for Even Start children on measures of school 
readiness and vocabulary? 



■ What gains are observed for Even Start adults on measures of functional 
literacy, GED attainment, employment status, annual income, parent 
expectations, and parenting skills? 



■ With what degree of confidence can observed gains be attributed to 
participation in Even Start? 




4. What are effective practices and programs? 



■ What participant characteristics (e.g., educational level of adults at entry, 
age of parent, size of family) are associated with program outcomes? 



■ What project characteristics (e.g., urban/rural location, degree of 

implementation, year-round versus school-year operation schedule, high 
federal cost per family versus low federal cost per family) are associated 
with program outcomes? 



■ What staff characteristics are associated with program outcomes? 

■ What service characteristics (e.g., amount of core service received, 
percentage of core services delivered at home versus in a center, percentage 
of core services delivered to parents and children together) are associated 
with program outcomes? 
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■ Is it possible to define subgroups of families based on need criteria (e.g., 
income, entry education level), and determine whether outcomes vary across 
the subgroups? 

While the above list includes all research questions articulated at the initiation of 
the current evaluation, some questions necessitated accumulating data over time. 
Thus, the 1993-94 Interim Report largely was restricted to descriptions of the 
projects and how they implemented the Even Start model. The 1994-95 report 
updated the descriptions of Even Start participants and their participation outcomes 
for the first time since program year 1992-93. This report on the 1995-96 
evaluation will add an examination of project characteristics with reference to the 
number of years the projects have operated Even Start. 



The Even Start Information System (ESIS) 

The ESIS represents a modification of the NEIS used in the first evaluation. 

Like the NEIS, the ESIS is used to collect a common set of data from all Even 
Start projects to generate ongoing information about such issues as types of 
projects being funded; nature and intensity of services offered; interagency 
collaboration; major difficulties in program implementation; participating 
families; and families’ participation outcomes. 

Each Even Start grantee is responsible for completing four ESIS forms: 5 

Form A: Preliminary Project Information collects information on the 
community context for the project. 

Form B: Project Description collects data on the project budget, program 
design, recruitment strategies, family education services, family support services, 
staffing, implementation barriers, technical assistance needs, and local 
evaluation. 

Form C: Participant Characteristics at Intake collects information on the 
socioeconomic status of the participating families and the demographic 
characteristics and educational background of each participating parent and 
child. 

Form D: Participation in Services identifies the educational and 
non-educational services in which each adult and child participated during the 
program year and the extent of their participation. 

Combined across all projects, the ESIS data are used to describe the Even Start 
program as a whole. The data also are used to categorize projects into different 



5 Copies of the ESIS data collection forms are available from the U.S. Department of 
Education, Planning and Evaluation Service, 600 Independence Avenue, S.W., Room 
4168, Washington, D.C. 20202. 
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subgroups for further analysis. For instance, this report includes descriptions of 
service delivery and participation outcomes for projects grouped by their years 
of experience in operating Even Start and percentages of teen parents they serve. 



Information about program outcomes for children and parents, as well as detailed 
participation data, are submitted to the evaluation contractor by a sample of fifty- 
seven projects. Sample projects collect and submit these data in addition to the 
same project-level and participant-level data that all the Even Start projects 
submit each program year. The Sample Study projects agreed to collect more 
comprehensive data on participants for up to three years. This approach of 
collecting broad-based data from all of the local projects and more 
comprehensive information on educational and performance outcomes from a 
much smaller number of projects minimizes the burden of data collection for this 
evaluation and allows for data collection over a time period that easily 
encompasses the tenure of most families’ participation in the Even Start program. 

The Sample Study projects were selected randomly to represent urban and rural 
areas in all regions of the country. These projects were initially funded in 1992 
or 1993. By the 1995-96 program year, they were in their third or fourth year of 
operation. 

Projects participating in the Sample Study were asked to administer assessment 
measures to monitor the impacts of the Even Start educational services on 
participating parents and children. During the instrument selection process, 
instruments were chosen that addressed the following criteria: ease of 
administration for project staff; minimal burden for project participants; and 
appropriateness of the measure for assessing the three core areas of Even Start 
services (e.g., English language literacy skills of adults, the quality of the home 
environment provided by parents for their children; and the effect of early 
childhood education on school readiness and language development for 
children). 

The outcome measures for each of these areas are discussed further below. The 
specific outcomes for children participating in Even Start are measured by the 
following assessments: 

■ The Preschool Inventory (PSI) for school readiness skills; and 

■ The Preschool Language Scale-3 (PLS-3) to measure language development. 

To examine the outcomes of adult education, projects in the Sample Study have the 
choice of administering one of two tests to each participating adult: 

■ The Comprehensive Adult Student Assessment System (CASAS), an adult- 
oriented functional assessment system that measures a broad range of adult 
literacy skills and their application in real life domains; or 
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■ The Tests of Adult Basic Education (TABE) Reading and Mathematics 
subtests for participants in GED preparation programs and some adult 
secondary education programs. 

To assess the outcomes of parenting education, the Sample Study projects use: 

■ The Home Observation for Measurement of the Environment (HOME) 
Screening Questionnaire. 

To obtain a true baseline measure of adult and child skills prior to participation 
in the program, only families new to Even Start were included in the Sample 
Study. In addition, only families in which at least one adult and one child spoke 
either Spanish or English were to be tested, because the measures are available 
in only these two languages. 6 

Multiple parents and children from the same family could be included in the 
Sample Study. Unlike the first evaluation, where projects were instructed to 
select a target adult and child for testing, projects in the Sample Study were told 
to include parents who were eligible for and expected to participate in Even Start 
core services. Also to be tested were all children in a family who were between 
2 and 5 years of age at program entry and who would be participating in early 
childhood education provided by Even Start or a collaborating agency. 

The Sample Study projects were selected in the spring-summer of 1994 and 
received training on the Sample Study measures and procedures in August and 
September 1994. Pretest measures were to be administered to parents and 
children within thirty days of the start of program services. The posttest 
occurred at the end of the 1994-95 program year or when the family was 
planning to exit the program (whichever came first, as long as it was at least 
three months after the pretest). Families still enrolled in Even Start in the spring 
of 1996 were to be tested again as a one-year follow-up. Families that enrolled 
in these fifty-seven projects in the fall of 1995 also were to be included in the 
Sample Study, with the pretest and posttest in 1995-96 and the follow-up test in 
1997. 



6 Although the child outcome measures, the Preschool Inventory and the Preschool 
Language Scale, are available in English and Spanish, none of the outcome measures 
for adults are administered in any language other than English. The decision to use 
assessment instruments that measure adults’ progress in English language skills 
reflects the programmatic goals of developing English language proficiency. Over 
the past several years, however, the proportion of the limited English proficient 
(LEP) participant population has increased, which means that the outcome measures 
are not equally available for all Sample Study participants, and further, that 
inferences about the program are applicable only to those participants for whom we 
have outcome data. 
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Site Visits to Migrant Education Even Start Projects 
and Tribal Even Start Projects 



The current evaluation included site visits to three of the fourteen Migrant 
Education projects and three of the nine tribal Even Start projects operating in 
1994-95. The visits focused on the special features of these Even Start projects 
and on the appropriateness of the ESIS for collecting data from these sites. 
Information gathered from the two sets of site visits has been summarized in two 
reports. 

The components of the current evaluation are summarized in Exhibit 2.1 . 



Scope of the 1 995-96 Evaluation 



Universe Study 

The scope of the current evaluation has expanded considerably since 1993-94 
due to the growth in the number of projects (Exhibit 2.2). In 1995-96, there were 
576 Even Start projects nationwide. Of these, 98 percent (563 projects) returned 
at least some evaluation data by the final due date. The thirteen projects not 
included in the evaluation analyses were distributed across eight states in all 
regions. Thus, the exclusion of these projects from analyses should not bias the 
national program description. The evaluation results presented in this report 
essentially represent the entire Even Start program. 

The 563 projects that submitted evaluation data represent all three types of 
grantees as shown in Exhibit 2.2. The distribution of reporting projects by state 
is presented in Exhibit B.l in Appendix B. 

For the 1995-96 evaluation, the 563 reporting projects submitted at least some 
participation data on 30,000 families, 34,400 parents, and 45,100 children. 
Chapters 3 through 6 and Chapter 9 of this report present the findings based on 
analyses of data from these projects, families, and individual participants. 
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Exhibit 2.1: Components of the Even Start Evaluation 
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Exhibit 2.2: Number of Projects Participating in the Even Start 

National Evaluation: Program Years 1993-96 




fype ol' Project" 



IgpVrcent ) 

?rbj egls-R e port ing~ 



Number of Project 
Operatin'* 



1993-94 Total I 1 *HM 


r 439 (90%) 


| | j|!|j 


State-administered Even Start Projects 


420 (92%) 


450 


Migrant Education Even Start Projects 


10 (45%) 


22 


Tribal Even Start Projects 


9(100%) 


9 


1994-95 Total 


476 (93%) 


513 


State- ad ministered Even Start Projects 


458 (93%) 


490 


Migrant Education Even Start Projects 


11 (79%) 


14 


Tribal Even Start Projects 


7 (78%) 


9 


1995-96 Total 


563 {98%} 


576 


State-administered Even Start Projects 


546 (98%) 


558 


Migrant Education Even Start Projects 


9(100%) 


9 


Tribal Even Start Projects 


8 (89%) 


9 



Note: The numbers of state-administered, Migrant Education, and tribal projects reported for 1993-94 
may be somewhat inflated since there was some confusion regarding the definition of an “Even Start 
project ” in the first year of the second evaluation. For example, programs located across several states 
but supported by a single Migrant Education Even Start grant may have been reported as separate 
projects. Since the 1994-95 evaluation year, the definitional problem was clarified by strictly equating 
each federally-administered grant and state-administered subgrant as a project, regardless of the 
number of program sites. 



Exhibit reads: For the 1995-96 national evaluation, 546 state-administered Even Start projects 
submitted data, representing 98 percent of the total of 558 state-administered projects operating in 
1995-96. 



Sample Study 

Of the fifty-seven projects in the Sample Study, we received assessment test data 
from fifty-four projects (95 percent). 7 Exhibit 2.3 shows the number of parents 
and children with valid test data from the Sample Study. Individuals with out-of- 
range scores or missing data were excluded from these counts. In addition, 
posttests that were administered less than three months after pretests were not 
included in the analyses. 

Approximately 1,100 children were tested at pretest on the PSI and PLS-3. 

There are fewer parents than children in the study (approximately 260 with 
CASAS and 725 with TABE) for two reasons: (1) the TABE and CASAS are 
administered in English only; and (2) there are more likely to be multiple 
children but only one parent tested per family. These parents and children 



7 This figure includes all projects that submitted any data as part of the Sample Study. 
Only fifty-three projects submitted valid outcome data. As a result, the analyses 
described in Chapters 7 and 8 are based upon data from fifty-three Sample Study 
projects. 
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represent 327 families with at least one test score at pretest and posttest for both 
adults and children. 

The number of parents and children in the Sample Study continues to be lower 
than we expected. This is due to the following factors: Many of these programs 
that were in their second or third year of operation did not enroll many new 
families in the fall of 1994 but continued to serve families who had joined in 
previous years. Therefore, to augment the number of families with test data, we 
asked projects in the Sample Study to include those new families who enrolled in 
Even Start for the first time during the fall of 1995. It also is clear that larger 
numbers of families enroll in Even Start than the number of pretest and posttest 
scores would indicate. In other words, far fewer families have scores for the. 
pretest and one or two posttests than have scores for the pretest alone. 



Exhibit 2.3: Number of Parents and Children in the Sample Study at 

Pretest and Posttest (1994-95 and 1995-96) 



yy ■ ^ \ • ' : : . : - : ’■ ' :• 

y'r • v. ' ... ■' V<.; ■, 

Measure 


•• . 

* • \ \ S j ' :> • ; r ’• 

Number, with 
v ; Protest : • 


Number with 
Pretest & 
Posttest 1 


: Number vvith;^ ; 

Pretest. ■ 
Post test 1, ;m<i 
Post test 2 -':: ; 


CASAS reading 


290 


177 


17 


CASAS math 


257 


152 


19 


TABE reading 


748 


328 


26 


TABE math 


725 


304 


22 


PSI 


956 


603 


42 


PLS-3 Auditory 


1126 


785 


108 


PLS-3 Expressive 


1070 


784 


87 


PLS-3 Total 


1118 


781 


87 


HOME Screening Questionnaire 


1031 


438 


18 



Exhibit reads: 290 parents were tested at pretest on the CASAS reading test ; 177 parents were tested at 
both pretest and posttest on the CASAS reading test , and 17 were tested at the second posttest as well. 



The number of adults with data from both the pretest and posttest (who can be part 
of an analysis of change or gain over the program year) drops by nearly half of the 
original number at pretest; for children, the reduction in sample size is less 
dramatic. The families with only pretest data differ marginally from those with 
pretest and posttest data on demographic variables such as family income, 
employment status, and language spoken in the home; families with both pretest 
and posttest data are more likely to be employed, have higher incomes, and speak 
languages other than English at home. However, significantly fewer families with 
pretest and posttest data are headed by a single parent (39 percent) than families 
with only pretest data (50 percent). In addition, mothers’ education among the 
group with pretest and posttest data is almost a grade-level higher than among the 
pretest only group (1 1.2 years versus 10.5 years). 

The group with both pretest and posttest data may have more family support 
because there is a spouse or partner to share responsibilities. This hypothesis gains 
support when we look at the reasons for discontinuing participation in the program 
among families without posttest data. Among the group of families with exit data 
(n=721), 28 percent either were dropped from the program for lack of attendance 
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or left because of a lack of interest; 4 percent left due to a family crisis; and 17 
percent moved out of the area. Additionally, 3 1 percent of the families with pretest 
and posttest data left the program because they completed their goals, contrasted 
with only 14 percent of the families with pretest only data. Given these reasons for 
more than one-half of the original Sample Study participants leaving the program, 
the group of families with both pretest and posttest data may not be representative 
of all families in Even Start. This threat to the validity of the Sample Study data 
should be kept in mind when interpreting the program effects presented in Chapters 
7 and 8 of this report. 



Statistical Analysis 

The evaluation findings reported in Chapters 3-6, and 9 are based on data 
representing essentially all Even Start projects and participants — the universe of 
the Even Start program — for program years 1994-95 and 1995-96. Descriptive 
statistical analyses (including cross tabulations of two or more variables, means, 
standard deviations, and univariate and multivariate analyses of variance) were 
used to compute (1) the numbers and percentages of projects and participants 
who provided specific categories of responses and (2) averages and ranges of 
information such as the number of instructional hours for either all or various 
subgroups of respondents. 

Since the statistical analyses reported in Chapters 3-6 and 9 were based on 
“population data” (the universe of the Even Start program), the selection of 
results described throughout this report is based upon more than statistical 
significance alone. We discuss differences that are numerically large (e.g., 50 
percent versus 80 percent) and results that appear to have practical and/or 
programmatic implications. 

The importance of specific findings depends to a certain degree on the interests 
of stakeholders rather than any statistical rales. For example, a 5-percentage- 
point increase in the percentage of families participating in all core services 
would have accounted for roughly 1,600 more families receiving full Even Start 
services nationally in 1995-96. While this rate of increase for a typical local 
project with sixty families would have affected two or three families, such 
changes begin to have wider meaning in the aggregate. Thus, the practical 
implication of this finding may be different for federal policymakers, local 
service providers, and the lives of individual participants who contribute to the 
increase. 

Analyses reported in Chapters 7 and 8 are based on samples of projects and 
participants selected for the Sample Study. Most of the findings about outcomes 
described throughout this report are based upon pretest and posttest data 
collected across program years 1994-95 and 1995-96. While we do have limited 
posttest #2 data on some measures, there are so few adults or children (generally 
under 15 percent of those with pretest and posttest #1 scores) that we base the 
majority of our analyses on simple pretest to posttest #1 differences. We report 
statistically significant difference scores as appropriate or as indicated. 
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In addition to the descriptive analyses, exploratory multiple regression analyses 
were performed to examine relationships among participant characteristics, 
program services, and outcomes. These analyses have produced inconclusive 
results. For the final report prepared at the conclusion of program year 1996-97, 
the descriptive information from all years of the evaluation will be used to 
pursue hypotheses-testing analyses further using univariate and/or multivariate 
analyses as appropriate and as indicated by the robustness of the data. 
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Even Start has grown steadily since it began in 1989-90 with seventy-six projects 
serving approximately 2,500 families. Seven years later in 1995-96, 
approximately 31,500 families participated across 576 projects. Despite this 
steady increase in numbers, many characteristics of Even Start families have 
remained relatively stable. 

There were, however, reasons to expect some changes in participant profiles in 
1995-96, especially among new families. One was the 1994 reauthorization of 
Even Start that extended program eligibility to teen parents who had been 
ineligible for services under the Adult Education Act because of age or because 
they were enrolled in school. This change became effective for program year 
1995-96. The reauthorized law also strengthened the mandate for the program to 
serve families most in need of Even Start services. 

Another factor that could affect Even Start participant profiles is welfare reform. 
The new five-year lifetime limitation on receipt of assistance, coupled with the 
necessity to obtain employment to receive benefits, may increase the need among 
low-income families for educational and job training services aimed at achieving 
economic self-sufficiency. Conversely, welfare reform could have the opposite 
effect on Even Start families; the emphasis on job training and employment may 
interfere with efforts toward educational and family literacy goals. Overall, 
these developments are likely to create new challenges for Even Start services. 

This chapter begins by presenting the basic demographic characteristics of 
families participating during 1995-96, including family income and parents’ 
employment status. (Low family income is a statutory requirement for selecting 
the “most in need” families to participate in Even Start.) The second section of 
the chapter describes other family characteristics that reflect the extent of 
families' need for Even Start educational and support services. These 
characteristics include parents’ and children’s educational backgrounds, parents’ 
English proficiency, and parents’ primary reasons for enrolling in Even Start. 

The entire discussion of participant characteristics is guided by one underlying 
question: Is Even Start, which is designed to combat the intergenerational cycle 
of poverty and low literacy, serving families who are most in need of family 
educational services? 

Before discussing participant characteristics, however, we must note that 
imprecise wording of some questions in the evaluation instrument introduced 
some ambiguity into the analysis findings. One of the most serious examples of 
this problem is a lack of clear distinction between the terms family, household, 
and participating adult. These terms were used somewhat inconsistently in 
several related questions (e.g., amount and main source of income for a family, 
number of people who live in a household, structure of a family, and receipt of 
welfare for a participating adult). These data do not allow us to assess precisely 
the economic status of a family unit participating in Even Start because the 
economic unit may include more people living in the household (e.g., parents of 
teen parent) and the respondent may have reported only the income of the 
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